vincent viafore , 46 , from poughkeepsie was on the hudson river near newburgh , new york , with angelika graswald on sunday .
he was thrown out of the boat when they hit rough waters .
she was rescued by people in a nearby boat and made it to shore .
residents say the water at this time of year is ` precarious ' as it is so cold .